AD-A214  782 


4 


i 


INFORMATION  CAPACITY  OF  THE  MATCHED  GAUSSIAN  CHANNEL  WITH  JAMMING. 
I.  FINITE-DIMENSIONAL  CHANNEL 


C.R.  Baker  and  I.F.  Chao 


Department  of  Statistics 
University  of  North  Carolina 
Chapel  Hill.  NC  27599.  U.S.A. 


Department  of  Mathematics 
Soochow  University 
Taipei,  Taiwan,  ROC 


Unannounced 

Justification. 


LISS-34 
April  1989 


Distribution/ 


Abstract 


£ 


□ 


Availability  Codes 


Avail  and/or 
Special 


Information  capacity  is  considered  for  the  finite-dimensional  additive 
Gaussian  channel  subject  to  jamming.  The  problem  is  modeled  as  a  zero-sum 
two-person  game  with  mutual  information  as  payoff  function.  The  jammer  does 
not  control  the  ambient  Gaussian  noise,  which  is  not  assumed  negligible.  The 
unique  saddle  point  and  saddle  value  are  determined,  along  with  the  jammer’: 
minimax  strategy.  \ 


Research  supported  by  ONR  Grant  N000H-86-K-0039  and  NSF  Grant  NCR8713' 


DISTRIBUTION  STATEMENT  A 

Approved  for  public  release; 
Distribution  Unlimited 


UNCLASSIFIED 


security  classification  of  this  face 


1a  REPORT  SECURITY  CLASSIFICATION 

UNCLASSIFIED 


2a  SECURITY  CLASSIFICATION  AUTHORITY 


2b.  OECLASSIFICATION/OOWNGRAOING  SCHEDULE 


4.  PERFORMING  ORGANIZATION  REPORT  NUM8ERIS) 


REPORT  DOCUMENTATION  PAGE 


lb.  RESTRICTIVE  MARKINGS 


3.  OISTRI8UTION/A  VAILABILITY  OF  REPORT 

Approved  for  Public  Release: 

Distribution  Unlimited 


5.  MONITORING  ORGANIZATION  REPORT  NUMBER(S) 


6a  name  of  performing  organization 

Department  of  Statistics 


6c.  AOORESS  (City.  Slat a  and  ZIP  Coda) 

University  of  North  Carolina 
Chapel  Hill,  North  Carolina  27514 


b.  OFFICE  SYMBOL  7a.  NAME  OF  MONITORING  ORGANIZATION 
(If  applicable) 


7b.  AOORESS  (City,  State  and  ZIP  Code ) 


(If  applicable > 


S*.  NAME  OF  funoing/sponsoring 
ORGANIZATION 

Office  of  Naval  Research 


8c  ADDRESS  iCity.  State  and  ZIP  Coda) 

Statistics  §  Probability  Program 
Arlington,  VA  22217 


11-  TITLE  (Include  Security  Classification) 

Information  Capacity  of  the  Matched  ... 


12.  personal  AUTHORtS) 

C.R.  Baker  and  I.F.  Chao 


13a  TYPE  OF  REPORT 

TECHNICAL 


16.  SUPPLEMENTARY  NOTATION 


9.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 

N00014-86 

-K-0039 

, 

1 10.  SOURCE  OF  FUNOlNG  NOS. 

FROG  RAM 

PROJECT 

TASK 

WORK  UNIT 

ELEMENT  NO. 

NO. 

NO. 

NO. 

13b.  TIME  COVEREO 
FROM _  TO. 


14,  DATE  OF  REPORT  /Yr.,  Mo..  Day) 

April  1989 


15.  PAGE  COUNT 

36 


COSATl  COOES 


GROUP 


18.  SUBJECT  TERMS  (Continue  on  reverse  if  necessary  and  identify  by  block  number) 

Information  capacity,'  Additive  Gaussian  channel, 
Mutual  information,  Minimax  strategy. 


19.  ABSTRACT  (Continue  on  reverse  if  necessary  and  identify  by  block  number) 

■— —  Information  capacity  is  considered  for  the  finite-dimensional  additive  Gaussian 

channel  subject  to  jamming.  The  problem  is  modeled  as  a  zero-sum  two-person  game 
with  mutual  information  as  payoff  function.  The  jammer  does  not  control  the 
ambient  Gaussian  noise,  which  is  not  assumed  negligible.  The  unique  saddle  point 
and  saddle  value  are  determined,  along  with  the  jammer's  minimax  strategy. 


11.  Title  Cont . :  Gaussian  Channel  with  Jamming,  I.  Finite-Dimensional  Channel. 


20.  OISTRI0UTION/A VAILABILITY  OF  ABSTRACT 
UNCLASSIFIEO/UNLIMITEO  SAME  AS  RPT.y®  OTIC  USERS  □ 


22a  NAME  OF  RESPONSIBLE  INDIVIDUAL 

C.R.  Baker 


21.  ABSTRACT  SECURITY  CLASSIFICATION 


22b.  TELEPHONE  NUMBER 
(Include  Area  Code) 

(919)  962-2189 


22c.  OFFICE  SYMBOL 


DO  FORM  1473,  83  APR 


EOlTlui  .AN  73  ...  OBSOLETE. 


UNCLASSIFIED _ 

security  classification  of  this  page 


1.  INTRODUCTION 


In  the  classical  additive  Gaussian  channels,  the  noise  process  in  the 

channel  is  assumed  to  be  fixed  and  known  to  the  coder.  This  assumption  is 

frequently  not  satisfied.  One  way  to  approach  the  capacity  problem  in  such 

situations  is  to  adopt  a  game- theoretic  formulation  with  mutual  information  as 

the  payoff  function.  This  is  also  a  natural  approach  to  modeling  the  capacity 

problem  when  there  is  an  intelligent  jammer  adding  noise  to  the  channel.  Such 

a  model  was  discussed  by  Blachman  (1957)  and  Dobrushin  (1961).  However,  no 

substantive  results  were  obtained  on  this  problem  until  the  1980‘s.  The  first 

paper  to  obtain  such  results  was  apparently  that  of  McEliece  and  Stark  (19S1) 

(see  also  McEliece  (1983),  and  Korden,  Mason  and  McEliece  (1985)).  Their  model 

(essentially  one-dimensional)  deals  with  the  average  mutual  information  I(X;Y) 

between  X  end  Y,  where  Y  =  X  +  Z.  X  is  the  channel  input,  Z  the  added  noise.  X 

and  Z  are  assumed  fo  be  independent.  The  coder  controls  the  input  X;  X  belongs 

to  a  class  S.  The  jammer  controls  the  noise  Z;  Z  belongs  to  a  class  T.  One 

uses  $(X;Z)  =  I(X;Y)  as  the  payoff  function  of  the  game.  The  coder’s  program 

is  to  find  C'  such  that  C*  =  sup  inf  4(X;Z),  and  the  jammer’s  program  is  to 

XeS  ZeT 

find  C"  such  that  C”  =  inf  sup  $(X;Z).  If  it  happens  that  C  =  C'  =  C”  = 

ZeT  XeS 

$(Xq,Zq),  then  (Xq.Zq)  is  called  a  saddle  point.  Therefore,  the  framework  is 
based  partly  on  game  theory  and  partly  on  information  theory.  McEliece  and 
Stark  have  shown  that  under  certain  restrictions  there  exist  ’’saddle  point” 
coding  and  jamming  strategies  which  are  simultaneously  optimal  for  both  the 
coder  and  the  jammer . 

In  this  paper,  we  also  adopt  the  game  theory  approach.  The  capacity 
problem  is  modeled  as  a  zero-sum  two-person  game.  The  payoff  function  used  for 
this  game  is  the  average  mutual  information.  It  is  assumed  that  the  channel 
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contains  an  additive  ambient  Gaussian  noise  and  a  hostile  additive  jamming 
noise.  Thus,  the  noise  added  in  the  channel  is  partly  controlled  by  an 
intelligent  jammer  and  partly  due  to  the  natural  noise,  while  in  the  model  of 
McEliece-Stark  the  noise  is  completely  controlled  by  the  jammer.  Both  the 
coder  and  the  jammer  are  subject  to  certain  energy  constraints.  In  our  model, 
it  is  assumed  that  the  natural  ambient  Gaussian  noise  is  known  to  both  the 
coder  and  the  jammer,  and  that  the  coder’s  constraint  is  given  in  terms  of  the 
RKHS  norm  corresponding  to  the  ambient  noise.  Thus,  our  model  is  that  of  a 
matched  Gaussian  channel  wl  *-K  jamming.  This  kind  of  jamming  ...cdcl  is  a  special 
case  of  a  mismatched  channel.  This  paper  begins  with  the  introduction  of  the 
model  and  the  necessary  background  on  optimization  methods.  The  information 
capacity  is  then  derived  for  the  finite  dimensional  channel.  The  solution 
includes  the  optimum  strategy  for  the  jammer.  The  solution  to  the  capacity 
problem  for  the  infinite  dimensional  channel  is  given  in  Baker  and  Chao 
(1989). 

2.  MATHEMATICAL  MODEL 

The  channel  to  be  considered  is  the  matched  Gaussian  channel  with  jamming 
and  without  feedback.  The  i-^annel  output  is  Y  =  X  +  N.  where  N  is  a  second 
order  noise  due  to  the  natu;  loise  W  and  the  independent  jamming  noise  J.  It 
is  assumed  that  they  are  additive,  i.e.,  N  =  W  +  J.  It  will  be  seen  below  that 
the  optimal  jamming  noise  J  is  Gaussian.  Therefore  it  is  sufficient  to 
consider  the  matched  Gaussian  channel  subjected  to  Gaussian  jamming;  the 
channel  is  then  a  special  type  of  mismatched  Gaussian  channel.  X  is  the 
message  process.  All  stochastic  processes  considered  have  their  sample  paths 
in  R^.  Of  course,  the  results  hold  for  any  M-dimensional  inner  product  space, 
will  denote  the  covariance  matrix  of  W;  R.  is  the 
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covariance  matrix  of  J.  We  assume  WLOG  that  R^  is  strictly  positive.  We  use 
interchangeably  to  denote  both  the  space  SR**  and  the  M-dimensional  inner 
product  space  (IR^,  <*,•>),  <u,v>  =  l^_^u^v^. 

2.1.  Bounds  on  Information  Capacity 

Let  Pj  and  Pg  be  two  probability  measures  defined  on  the  same  measurable 
space  (fi.?).  The  entropy  Hp  (P^)  of  P^  with  respect  to  P ^  is  defined  by 

Hp  (Pj)  =  sup  SjPjCC^flogfP^C^/PgfCj))]  where  the  supremum  is  taken  over 

all  finite  measurable  partitions  (C^)  of  0.  We  consider  a  message  process  X 
defined  by  a  probability  p^  on  the  Borel  sets  2&[R**].  with  the  observation. 

M 

noise,  and  transmitted  signal  processes  all  defined  by  probabilities  on  S6[R  ]. 
11*11  will  denote  the  norm  obtained  from  the  usual  inner  product  <*,*>  on  R^. 

Let  p^  be  a  noise  on  !S[R^]  which  is  not  necessarily  Gaussian.  Assume  is 
second  order.  Let  3l  be  a  class  of  covariance  matrices  on  R^.  Let  a  be  the 
class  of  second  order  probabilities  p^  on  &[R^]  having  a  covariance  matrix 
belonging  to  31.  3 L  represents  a  class  of  allowable  input  distributions 
determined  by  their  covariance  operators. 

M 

Lemma  1  flhara  (19781V-  Let  p  be  a  zero-mean  Gaussian  measure  on  Si[R  ]) 

N 

having  the  same  covariance  matrix  as  p^.  Then 

-€(p  0.2t)  *  *0 V*)  *  o'’*)  +  Hu  (^) 


N 


N 


where  ^(p^iX)  =  sup  {I(X.Y):  X€&} ,  Y  =  X  +  N  and  I(X,Y)  denotes  the  mutual 
information  between  the  input  X  and  the  output  Y. 


Remark-'  Ihara’s  result  shows  that  the  information  capacity  can  be  decreased  by 
choosing  Gaussian  noise  among  a  class  of  second  order  processes  having  the 
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same  covariance  matrix.  We  thus  assume  henceforth  that  the  jamming  noise  is 
Gaussian. 


2.2.  Gaussian  Channel  With  .lamming 


Let  be  the  RKHS  for  the  covariance  matrix  R^.  with  norm  IMI^,  defined 
2 

by  llxllw  =  IIR^  xll  .  It  should  be  noted  that  the  elements  of  consist  of  all 
of  IK**.  In  this  finite-dimensional  case,  one  could  replace  IMI~  with  11*11  while 
replacing  N  with  R^*N  and  J  with  R^*J.  The  11*11^  norm  *s  uset*  because  of  the 
extension  to  infinite-dimensional  Hilbert  space  considered  in  Baker  and  Chao 
(1989),  where  the  RKHS  will  not  consist  of  all  elements  of  the  Hilbert 
space. 

Let  S  be  the  covariance  matrix  defined  by  S  =  R^*R  R^*,  so  that  R^  = 

Rw  +  Pj  =  R^(I+S)rJ. 


The  constraint  for  the  coder  is 


E  IIXIlJ  S  P,  . 

^  W  1 


(1) 


Under  the  constraint  (1),  let  (^(Pj)  =  sup  Ifri^].  Q  is  the  set  of  ^  that 
satisfy  (1). 

From  the  results  of  Baker  (1978),  one  can  limit  attention  to  the  case 

x  x 

where  is  Gaussian  with  covariance  R^  =  2  Tnf^un3  ®  [R^u^],  where  >  0, 
n  £  1,  <  00 ,  (un<  n^l}  is  a  CONS  and  (u®v)x  =  <v,x>u.  Then  iCf^y]  = 

i  Inlog(l+rn).  Moreover.  E  IIXIlJ  =  E  MRjJ»A(X)H2  =  TrR^R^2  = 

A  A 


2  Tnl.(I+S)*u\ll2  i  P^.  Suppose  now  that  S  is  fixed.  Setting  z^  = 

t  1I(I+S)2U  u  II2.  CL(P)  =  sup  (1/2)  2  Iog(l+z  (1+tt  )  * )  where  the  supremum  is 
n  II  *  n  n  n 

over  the  sequences  (z  )  and  CONS  (v  .  n£l}  in  !R**  such  that  2  z  <  P,  ,  and 

n  n  n  n  l 

y  =  <Sv  ,v  >,  n£l.  Here,  v  =  U*u  . 
n  n  n  n  n 
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The  quantity  of  interest  is  As  seen,  it  is  a  function  of  (*r  )  and 

(zn) .  defined  as  above.  Henceforth,  we  make  this  explicit  by  defining 

F(z,tt)  =  (£)  I  logfl  +  z  (1+“*  )  *1 
n  L  J 

where  (z  )  and  (y  )  are  defined  above. 
v  n'  v  n' 

In  general,  sup  inf  F(z.tt)  £  inf  sup  F(z,*r)  (see,  e.g.,  Barbu  and 
z  y  y  z 

Precupanu  (1986)).  Equality  can  hold  in  this  relation  without  the  common  value 
being  attained  by  a  point  (z  ,y  ).  If  equality  does  hold,  we  say  that  the  game 

has  a  saddle  value.  The  value  is  attained  if  and  only  if  there  exists  an 

* 

admissible  point  (z  ,y  )  such  that 

sup  F(z,-y*)  £  F(z*,y*)  £  inf  Ffz*,^). 
z  y 

M  M 

The  point  (z  ,y  )  is  then  said  to  be  a  saddle  point  for  F.  and  of  course 

H  * 

F(z  ,t  )  is  the  saddle  value.  Existence  of  a  saddle  point  must  be  shown,  even 

if  a  saddle  value  exists.  When  a  saddle  point  does  exist,  then  obviously  sup 

z 

and  inf  in  the  above  inequalities  (which  is  then  an  equality)  can  be  replaced 
y 

by  max  and  min. 
z  y 

Of  course,  the  existence  and  definition  of  a  saddle  point  for  F  depend  on 

the  class  of  admissible  points  ( z.y ).  We  have  already  defined  the  admissible  z 

as  those  non-negative  real-valued  sequences  satisfying  2  v,z  <  P, ,  where 

n>l  n  l 

Pj  >  0  is  fixed.  We  now  discuss  the  class  of  admissible  y. 

The  constraint  2  vlz  <  P,  on  the  coder  is  equivalent  to  the  constraint 
n£l  n  1 

E  llxll™  £  P,  .  That  is.  z  =  t  ll(I+S)2U*u  11^,  where  (u  ,  n£l}  is  any  OONS  in 
pWl  nn  n  n  ' 

r  v 
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ftp,  U  is  the  unitary  operator  defined  above,  and  the  coder  has  covariance 


x  x 

matrix  R^  =  ^nTn^un®^un • 

A  constraint  that  one  might  naturally  assume  for  the  jammer  would  be  of  a 
2 

similar  nature:  llxll^  £  Pg-  This  is  the  same  as  Trace  S  £  Pg.  since 

x  x 

Rj  =  R^SR^.  Suppose  that  one  considers  the  infinite-dimensional  channel.  Since 
S  is  then  trace  class,  it  has  zero  as  the  only  limit  point  of  its  spectrum. 
Examining  the  expression  for  channel  capacity  given  in  Theorem  3  of  of  Baker 
(1987),  one  sees  that  for  the  infinite-dimensional  channel,  such  a  constraint 
would  not  enable  the  jammer  to  decrease  the  capacity.  This  holds  for  any  value 
of  Pg.  no  matter  how  large.  Thus,  in  the  infinite-dimensional  channel,  the 
jammer  must  have  a  constraint  that  is  of  a  weaker  form  than  that  for  the 
coder.  However,  in  the  finite-dimensional  channel,  we  shall  see  that  the 
saddle  point  solution  for  this  constraint  is  a  special  case  of  the  constraint 
we  use. 

2 

The  constraint  to  be  applied  on  the  jammer  is  E  llxll  £  P„.  It  will  be 

seen  that  such  a  constraint  provides  a  well-defined  game- theoretic  problem, 
and  it  can  be  seen  to  be  not  unreasonable  from  a  physical  viewpoint.  This 

constraint  can  be  written  in  terms  of  the  covariance  matrix  Rj  of  J: 

x  x 

Trace  Rj  £  P£.  Using  the  fact  that  Rj  =  RjySR^,  as  discussed  above,  the 


jammer’s  constraint  becomes 


Trace 


*  P2- 


Let  {en>  n£l}  be  the  CONS  of  eigenvectors  of  R^,  (X^)  the  corresponding 

eigenvalues,  and  suppose  that  A.  £  X0  2  • • ■  Z  X  >  ....  Our  constraint  on  the 

l  z  n 

jammer  is  that  Trace  Rj  £  Pg.  Thus, 

00  00 

p2  2  TrRj  =  TrRJS*!  =  *  J  VSe„'*„>' 
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The  basic  problem  can  now  be  summarized  as  follows.  F(z,ir)  = 

2  2  loeri+z  (l+-r  )  where  z  £  0  and  y  £  0  for  n  £  1,  and  2z  i  P,  .  (z  ) 

v,  &L  nv  n'  J  n  n  n  1  v  n' 

n^l 

^  2 

is  selected  by  the  coder,  z  =  t  ll(I+S)2U  u  II  ,  where  {u  .  n^l)  is  a  OONS  for 

nnn  1  n  ‘ 


n’ 


wi  th 


+  Rj.  The  jammer  chooses  his  covariance  matrix  R 

the  constraint  2  V1X  <Se  ,e  >  £  P_,  where  R~.  =  X  e  ®e  .  The  sequence  (y  )  is 
n£l  n  n  n  2  w  nnn  M  v  n' 

then  defined  by  y  =  <Sv  ,v  >,  where  v  =Uu,l<n<M. 
n  nn  n  n 

The  problem  as  formulated  does  not  explicitly  exhibit  a  constraint  on 
(t  ) .  This  apparent  ambiguity  will  be  removed  as  part  of  the  analysis. 


j  =  R^SR^,  subject  to 


2.3.  Optimization  And  Minimax  Theorems 

Here  we  summarize  fundamental  theorems  to  be  applied  to  our  problem. 


Lemma  2  (Danskin  (19671):  Suppose  that  the  set  x  =  (Xj,...,x  )  maximizes 
2fi(yt)  subject  to  the  side  condition  2y^  =  X,  y1  2  0.  Suppose  that  f^  are 
differentiable.  Then  there  exists  a  X  such  that 

f’(xi)  =  X  if  Xj  >  0 

f ;(Xi)  s  x  if  x4  =  o. 

Lemma  3  (Roberts  and  Varberg  (197311 :  Let  f  •'  U  -*  R  be  convex  on  a  convex  se t 
U  C  L,  where  L  is  a  normed  linear  space.  If  f  has  a  local  minimum  at  x.  then 
f(x)  is  also  a  global  minimum.  The  set  V  on  which  F  stains  its  minimum  is 
convex.  If  f  is  strictly  convex  ip  a  neighborhood  of  a  minimum  point  x,  then 
V  =  {x};  that  is,  the  minimum  point  is  unique. 

Lemma  4  (Barbu  and  Precupanu  (198611:  (general  von  Neumann  minimax  theorem). 
Let  Lj  and  Lg  be  reflexive  Banach  spaces,  with  U  C  L^  and  V  C  two  nonempty 
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bounded,  closed,  and  convex  subsets.  Let  f:  UxV  -*  R.  Suppose  that  for  each 
fixed  y.  f(x,y)  is  continuous  and  concave  on  U  and  that  for  each  fixed  x, 
f(x.y)  is  continuous  and  convex  on  V.  Then  there  is  a  saddle  point  (x.y)  for  f 
on  UxV  and 

max  min  f(x,y)  =  min  max  f(x.y)  =  f(x,y). 
x€U  y€V  y€V  x€U 

Remark •  For  the  finite-dimensional  channel,  we  shall  see  that  F  and  the 

constraint  conditions  for  z  and  t  satisfy  the  sufficient  conditions  of  Lemma 

o  o 

4.  Therefore,  there  exists  a  unique  saddle  point  (z  ,-r  ). 


3.  INFORMAT IOM  CAPACITY  WITH  JAMMING 


3.1.  Preliminary  Results 


Lemma  5  (Baker  (1987):  Suppose  that  the  jammer's  strategy  is  fixed,  given  by 
(-r^)  where  0  £  i  Tg  i  ...  i  -r^.  Then  the  maximal  value  of  F(z,-r),  denoted 
by  Fq(t').  is  given  by 

P.+^+K, 


„ ,  ,  A  \k  ,  rrvr*i 

F0(nr)  =  a  Zl  log  - 

1  (l+-r  }K  J 


where  K  is  the  largest  integer  such  that  P^  +  I^-r^  >  Ktt^,  and  the  coder’s 
optimun  strategy  is  to  select  z^  as  follows: 


z,  =  C  -  t  =  - “ - “■  -  -r  .  i=1.2 . K,  with  z.  =0,  i  =  k+ 1 

.  i  K  i  i 


Moreover,  the  maximum  is  uniquely  attained  when  the  coder  chooses  a  Gaussian 
signal  process  with  measure  and  covariance  operator  = 

I+tt^R^u^R^u^  .  where  S  =  I^^v^^v^ ,  v^  =  U*^  for  1  i  i  i  M,  and 
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{u^.  n21}  is  a  OONS  for  Hg- 


In  the  finite-dimensional  channel,  we  are  dealing  with  (z.'r)  contained  in 

irV.  W«?  wish  to  apply  Lemma  4  to  guarantee  existence  of  a  saddle  point  for 

F.  however,  F  is  given  in  terms  of  {"r  ),  where  t  =  <SU  u  ,U  u  >,  and  {u  , 

v  n^  n  n  n  1  n 

n£l}  is  selected  by  the  coder.  The  constraint  on  the  jammer  is  given  by 

2  A  <Se  ,e  >  <  P  This  constraint  needs  to  be  expressed  in  terms  of  (~r  )  in 

n  n  n  n  2  1  nJ 

order  that  Lemma  4  can  be  applied.  This  is  obtained  from  the  following  result. 


Lemma  6:  Without  loss  of  generality,  the  jammer's  minimax  strategy  can  be 
achieved  by  taking  S  =  ,  where  £  ^2'  y i  ^  0  f°r  *  £  M- 

Proof :  In  general,  the  jammer  wishes  to  select  y  in  order  to  minimize  Fq.  as 

M  M 

defined  above.  He  selects  S  =  2  .  ,tt  U  u  ®U  u  ,  where  (u  ,  n>l}  is  a  OONS  for 

n2l  n  n  n  1  n  -  1 

H0,  subject  to  the  constraint  2 . . ,X. <Se . , e . >  £  P-,  where  R,„  =  2..,A.e,®e.. 

2  i2l  i  i  i  2  w  i>l  i  i  i 

Since  the  value  of  Fq(^)  depends  only  on  the  choice  of  {y  )  and  not  on 

the  choice  of  {u  ,  n21}.  it  is  sufficient  to  prove  that  if  S  =  2,v,t.v.®v.. 

n  K  i 2 1  i  i  i 

where  {v^ ,  i  <  M}  is  any  CONS  in  fl^,  then  2i^Xi<Sei  .e^  2  ^  this 

inequality  is  satisfied,  then  any  choice  of  (i r  )  and  (u^,  n21}  satisfying  the 
constraint  21^^X^<Sei ,e^>  £  P ^  will  provide  a  value  of  F^  which  is  also  ob¬ 
tained  by  an  admissible  operator  S'  =  2. . .nr  ,e.®e. ,  since  2A.<S'e.,e.>  =  2X  y  . 

i  2 1  i  i  a  l  ii  i  i 

Thus,  to  complete  the  proof  it  is  sufficient  to  show  that 

^iVSvV  >  tiVf 

Let  {v^,  l£i£M}  be  the  OONS  of  the  eigenvectors  of  S  and  {-r.,  1  < i <M }  be 
the  corresponding  eigenvalues.  Assume  £  ■ ■ •  £ 
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Consider 


M 


Def ine  a 


ij 


vi  *  l  <vi-ej>ej' 
j=l 

,lvi"2  =  l  <Vi'ej>2  =  1 
j=l 

M  M 

*  <vrej>:  then  l  a?j  =  l 

i=l  j=l 


t .  =  }  <e . , v  .  >v  . 

i  L  1  j  j 


j=l 

M 

lie  11^  =  \  <«*  .  .  v  ,>^ 

i  L  l  J 

j  =  i 


a.j  =  1,  and 


TrRtSBf  ■  TrR»s  =  2<ViVV 

1=1  i=l 

MM  M  MM 

*  Y  <  1  aijxj'j-  1  m  1  1  ajjVr 

1=1  j=l  k=l  1=1  j=l 


To  complete  the  proof  of  the  lemra  it  is  now  sufficient  to  obtain  the 
following  equality: 


M  M 


inf 

A=[a 


ij 


l  I  Yi.fi  *  1  Vi 

J  i=l  j=l  i=l 


where  A  =  [ajj]  is  a  real  unitary  matrix.  This  equality  has  been  proved  by  Fan 
(1951).  D 

We  have  now  reformulated  the  original  problem  into  the  following  form. 

The  payoff  function  is  F.  defined  on  rV. 


F(z.-t)  =  i  2  log 
i  =  l 


1  +  z  (1+nr  ) 
nv  n' 


-1 


where  z  €  U,  t  €  V, 
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In  this  form.  F.U,  and  V  sat'^t'y  the  conditions  of  Lemma  4,  so  that  a  saddle 
point  is  guaranteed  to  exist  for  F  on  UxV.  Moreover,  the  saddle  point  is 
obtained  by  minimizing  the  function  F^  with  respect  to  t ,  and  defining  z  as  in 
the  beginning  of  this  subsection  (as  in  Lerrma  5).  This  will  be  the  problem  to 
be  considered  in  the  remainder  of  this  section. 

It  should  be  emphasized  that  this  means  that  the  coder  and  the  jammer 


always  use  die  {e^,  n£l}.  They  are  o.n.  eigenvectors  of  S,  and  the  coder  uses 

the  covariance  matrix  R_,  =  2  (l+-r  )X  e  ®e  .  where  2  .  ,t  {  1+t  )  <  P,  ,  and 

X  n^l  nv  ny  n  n  n  n>l  nv  nJ  ~  1 

I.pX  ^  P0. 
n>l  n  n  2 

We  now  obtain  an  important  condition  in  order  that  (z,i)  define  a  saddle 


point. 


Lemma  7:  The  saddle  point  (z.i)  of  F  must  satisfy  the  following  condition:  If 


Tq  =  max{ifj . ,  then 


M 

P  +  2  nr  >  M-r  (M  >  2). 

i=l 


Proof :  Our  constraint  on  (t^)  is  £  ^2'  are  defined  to  be 

non- increasing:  X^+^  i  Xj.  i  i  M-l.  For  the  proof,  we  will  re-order  the  (X^) 
and  ('fj).  if  necessary,  in  such  a  way  that  (-r  )  is  non-decreasing.  Hence,  in 
the  proof  to  follow,  we  make  this  assumption;  we  do  not  assume  that  ( X ^ )  is 
non- increasing;  the  reordered  sequence  is  denoted  by  (X°).  From  Lemma  5,  this 
ordering  then  requires  that  (Zj)  be  non-increasing.  Now.  given  the  original 
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o  o  o 

saddle  point  (z  ,1  ),  which  fixes  the  indices  of  (X^),  we  require  that  any 
admissible  point  (z.ir)  also  satisfy  ("rn)  non-decreasing,  (z^)  non- increasing. 

O 

If  the  lemma  is  false,  then  there  exists  K  <  M,  such  that  K-r  > 

K+ 1 

If  o  o  o  o 

P  +  2j-Yj  £  Knr^f  and  (z  ,nr  )  is  a  saddle  point  of  F  with 

o  ,  o  o  A  y  o  ,  o  ,  o  M  o 

=  ^l’^2 - 0  *  “*1  *  t2  *  ••  *  TM:  2lVri  *  P2' 

ooo  o  o  o  o 

z  =  (z1,z2...,zM);  Zj  >  z2  i  ..  >  zK  >  0. 


z°  =  0.  i  =  K+l . M,  2^z°  =  Pr 

o  K  o 

Moreover,  =  0  if  and  only  if  2  ~t ^  =  Kir^. 

K  o 

First,  suppose  that  2  -r  +  P,  =  K-rv.  Choose  t  >  0  such  that 

1=1  1  1  K 

o  o  ooo 

£  <  ('rK+i“'TK)/2  and  e  <  )  •  Define  a  new  jamming  sequence 

by 

t j  =  v j ,  i  /  K,  K+l 

*  o  o  o 

-rK  =  -"k  +  e  \+1/\ 


K 


7  k+l  ~  ^K+l  e- 


Then  2  -r  +  P,  <  Kr,.,  and  by  Lenina  5. 
i=l  1  1  K 


*  K-l 
F  (-r  )  =  f  2  log 
i=l 


(K-Dd+ij) 


O  M 

Again  applying  Lenina  5,  FQ(-r  )  <  F0(nr  ).  Moreover,  the  sequence  (nr.)  is 

it  M 

admissible;  -r^  £  v  j  for  i  £  M-l  (so  that  the  conditions  of  Lemma  5  are 
satisfied),  and 
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N  M  M 

i^1Xi'ri  =  +  ^K^Nc+l7*!^  "  \+le  =  i^1Xi'lri  -  P2‘ 

K  o 

Next,  suppose  that  P.  +  I  7  >  K7,.. 

i=l  K 

o 

We  then  consider  the  derivative  of  Fq  with  respect  to  7^;  this  is  equal 


to 


r. _ s _ Li 


This  derivative  is  strictly  negative,  since 


K(1+7K)  <  Pj 


* K  ♦  4rr  11 


follows  that  if  we  can  define  tin  admissible 


sequence  (7*)  such  that  7*  differs  from  (7°)  only  for  the  indices  K  and  K+l, 


*  O  ^  u  ^  ^  Ho 

with  7k  >  7k  and  satisfying  K7^+1  >  I  +  Pj  ^  K7K«  then  FQ(7  )  <  FQ(7  ). 


o  o , 


This  will  then  contradict  (z  .7  )  being  the  saddle  point. 


Thus,  let  P  be  such  that  P  <  ^\+1~^k)/2’  \+lp/XK  <  ^K+l  ^k)/2’ 

4K  <  b  <  K*rpr4rl]/<K+i/>7>' B°« 

o  o 

that  7k+1  >  7k  is  necessary,  by  the  definition  of  K. 


Let  e  =  X^+^0/Aj£.  Now  define  (7^)  by 
i  /  K.  i  *  K+l 


»  o 

\  =  V 


*  o 

=  +  £ 


^K+l  ”  ^K+l  “ 

HO  H  H  H 

As  shown  above.  FQ(7  )  <  FQ(7  ).  since  K7^+1  >  Pj  +  >  KX^.  To  see 

the  last  inequality,  one  notes  that  2^_^7*  +  Pl  =  ^T-l^i  +  Pj  +  e  > 

OH  H  \C 

K(7^+e)  =  K7^.  The  inequality  K7^+^  >  Pj  +  can  be  seen  similarly: 

K(7k+i~7k)  =  K(7k+1-7k)  -  K(0+e) , 
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and 


Since  7*  -  =  a.  the  last  inequality  gives 


.  K  „  K  , 

>  pi  *  ♦  *  *  pi  *  tftV 


It  remains  to  show  that  (7^)  Is  an  admissible  strategy  for  the  jammer. 


First,  (^j)  is  non-decreasing,  since 


.  .  O  <Vl^> 

- 2 - *  - 2 - 


and 


o  D  ,  o  ^K+l'V  ^K+I^K* 

^K+l  '  P  >  ^K+l  2 2 


Moreover.  =  2^]  +  ^  ^  1  ?2 . 

The  sequence  (7^)  is  thus  non-decreasing  and  satisfies  the  jammer’s 
constraint,  so  is  an  admissible  strategy.  Q 

Remark .  The  content  of  Lemma  7  is  that  the  janmer’s  optimum  strategy  includes 

forcing  the  coder  to  spread  his  available  energy  across  the  entire  channel 

M 

(i.e..  the  coder  cannot  restrict  his  signal  to  any  proper  subset  of  K  ) . 

Lemma  8:  Suppose  that  the  jammer's  strategy  is  given  by  (7^).  If  there  exists 
K  such  that  and  7^  >  7^+j,  then  (7^)  is  not  a  minimax  strategy. 
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Proof :  From  Lemma  5  and  Lemma  7.  In  order  to  achieve  sup  F(z,nr)  the  coder  must 

z 

have  (2^)  defined  by 


\  • 


p. *  ^=ri 


TTk.  k  =  1.2 . M. 


We  consider 


F0(-) 


-  2 


M 

I 

i=l 


log 


V^rV11 


M(l+'ri) 


Note  that  the  ordering  of  {-r ^ )  does  not  affect  the  value  of  F^t),  since  all 
M  i . ’ s  are  used. 

l 

We  have  £  Pg.  Define  a  new  sequence  (nr*)  as  follows: 

nr*  =  nrj  i  /  K.  i  /  K+l 


=  ^K+l  +  fc 
^K+l  =  ''K 

where  e  >  0  is  such  that  -r^+j  +  e  <  nr^  and  ^(nr^j+e)  +  N(+1^K  ^ 

+  N(+1^K+1'  ^*rst  sh°w  that  Fq { "r** }  <  Fq{t).  First,  by  Lemma  6,  if  ( nr ^ ) 

is  a  minimax  strategy,  then  P^  +  2  M-r^,  where  yQ  =  max{n'^ . nr^}. 

Since  nrK  =  nrR+1  +  e  <  -rK  1  nr0>  Pj  +  =  Pj  +  +  6  >  Pi  +  ^ 

M"Tq  =  HnrQ,  7^  =  max{nrj . nr^} .  As  in  the  proof  of  Lemma  7.  Fq(->  )  <  F^nr), 

*  M 

since  (nr^ . nr^}  =  {nr^,  i  jt  K+l}  U  (t^+j  +  *}.  and  F^nr)  is  a  non-increasing 

function  of  nr^  for  any  fixed  i  £  M.  This  shows  that  (-rn )  is  not  a  minimax 

strategy  for  the  jammer,  providing  that  (nr^)  is  admissible. 

To  complete  the  proof,  we  need  to  define  e  >  0  such  that  2^  ,  X,n *  <  P,,. 

i=l  i  l  _  2 

Note  that  ^Xinr1  -  Z^X^  =  V'^K+l)  "  +  ^K+l^K+l”^  = 

(xk~xk+i^'tk~^k+i)  “  Nc6,  Let  6  *  ^xk'xk+i^1k"tk+P/xk-  711611 


Info. Cap. I-LISS  34  -  10/9/89  -  15 


i  2*^  =  P2.  while  F0(S)  <  F0(t). 


Henceforth  we  shall  assume  without  loss  of  generality  that  {-r ^ )  is  non- 


decreasing  (so  that  (Zj)  is  non- increasing) , 


Lemma  9:  Define 


A  =  {(z.-r):  0  ^  t1  $  -r2  ^  ^  tm. 

Z1  *  Z2  2  Z3  *  ••  *  ^  2  °*  ^l2!  *  V* 


*K  =  {(z.-r):  0  .  ^  =  ...  =  vK  i  Vl  i  ...  i  ,M.  *  P2> 

Z1  2  z2  2  • .  •  2  7^  ±  zK+1  l  ...  I  Zjj  £  0.  2^zt  i  Pj). 

For  K  £  M,  define  by  min  max  F(z,t).  The  saddle  point  (z.-r)  then 

7  z_ 

( z.7 JeAj^. 

belongs  to  A^^  =  ^  -A^+1  where  K  is  the  smallest  integer  such  that  <  C^+j. 
If  Cj  =  Cg  =  . .  .  =  Cjj,  then  the  saddle  point  belongs  to  Ajj. 

Proof:  L.  is  compact  and  convex  for  all  K,  0  $  K  i  M-l.  L  D  A.  D  ...  DA 

^  0  1  M-  1 

Aq  =  A.  is  well-defined,  by  Lemma  4,  and  £  C^,  0  <  K  <  M-l.  Moreover, 
ak  =  \  ~  Aj^+j  ^  AK  are  disjoint.  Let  2  F(zK’nrK^’  then  (V'V  is  the 

saddle  point  for  A.  To  complete  the  proof,  one  notes  that  a  unique  saddle 

point  (zK,'rK)  exists  in  each  of  the  sets  y^,  by  Lemma  4. 

If  =  Cj£+i’  then  applying  Lemma  3  to  the  strictly  convex  function  Fq, 
one  must  have  (z^^)  =  (ZK+1  .tK+1 ) :  i.e.,  the  saddle  point  for  AK  is  the 
saddle  point  for  A^+j.  If  <  C^.+j ,  then  the  saddle  point  for  A^  is  not 
contained  in  A^+j.  Since  A^  =  A^  -  A^+j,  the  saddle  point  for  A  is  then 
contained  in  A^.  Since  A^RAj  =  $  for  J  ^  K,  there  exists  exactly  one  K  such 
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that  (z!e'r|()  belongs  to  A^  and  is  a  saddle  point  for  F  over  A.  This  index  is 
uniquely  specified,  as  shown,  as  the  smallest  integer  K  such  that  <  Cp,+  ^, 
if  such  K  exists.  Otherwise,  -  ...  =  C^,  and  the  saddle  point  belongs 

to  Ajj.  □ 

3.2.  Solutions  to  the  Minimization  Problem 

In  the  following  algorithm,  we  will  derive  a  formal  expression  of  the 
minimax  solution  for  each  A^,  0  £  K  £  M-l.  and  give  the  necessary  and 
sufficient  conditions  such  that  the  solution  exists.  The  procedure  of 
searching  for  the  saddle  point  solution  is  started  from  K  =  0.  If  the  solution 
in  Aq  does  not  satisfy  the  necessary  and  sufficient  conditions,  the  algorithm 
then  searches  A^.  and  so  on.  We  shall  show  that  the  solution  reduces  to 
finding  the  solution  of  a  constrained  minimization  problem.  By  Lemma  4.  a 
saddle  point  must  exist. 

Define 


*K  ■  s’l”! . ^ 


M 


^i7i  *  P2: 


Z!  *  Z2  *  *  *K  1  *K+1  *  ZK+2  *  ■■ *  *  **  >  °- 


i  P,} 

1 


F(z,-r)  =  ~  log  (1+z.)  +  t  2  log  (1+  — — ) 

K+l  l+n1 


*  |  lo8  (1+Z,)  -2  2  log  (1+n  ) 

1  K+l  1 


By  Lemma  5  and  Lemma  7,  z^  =  Zj-ij,  i=K+l . M,  so  that 
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Therefore, 


M  M 

Kz.  +  2  (z.— r.)  =  Mz.  -  2  -r.  =  P 

1  K+l  1  K+l 


z,  = 


M 

Vk^I 


1  +  z. 


M 

M+P  +  2  t 
1  K+l  1 


M 


M 

K+P.+  2  x 
1  K+l  1 


M 


where  we  have  defined  =  1+t^,  i  =  K+l . M.  This  gives 


max  F(z.'r) 
z 


M  M 

F.(x)  =  |  log  (K+P+  2  x. )  -  14  2  log  x. 
1  Z  K+l  1  K+l  1 


7J-  log  M. 


Our  objective  is  to  maximize  -F^ 


subject  to 


M  M 

2  X  x.  £  P,  +  2  X 
K+l  1  1  z  K+l 


(Cj) 


1  <  *K+1  *  *  XM* 


(c2) 


M 

P ,  +  2  x  *  Mx^-K.  (C_) 

K+l  J 

Since  F^  is  strictly  concave  and  the  constraints  are  convex,  the 
minimization  problem  has  a  solution  if  and  only  if  the  Kuhn-Tucker  conditions 
are  satisfied;  the  solution,  if  it  exists,  is  unique  (see,  e.g. ,  Wismer  and 
Chattergy  (1978)). 


Lemma  IQ:  will  contain  the  saddle  point  for  F  if  and  only  if  K  is  the 

smallest  integer  i  M  such  that  the  above  constrained  minimization  problem  has 

if  if  * 

a  solution.  When  this  occurs,  and  x  is  the  solution,  then  (z  ,-r  )  is  the 


saddle  point,  where 


*  *  i 

^i  =  Xi  -  U 


i  =  K+l . H; 


i  i  K  (iq50) 
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i  =  1.2. 


,M. 


*  5  * 

z  =  (P  +  2  ir  )/M  -  Tf 
1  K+l  1 


Proof :  If  the  minimization  problem  has  a  solution  for  some  K,  then  the  minimum 
equals  min  max  F(z,ir).  Since  A^  =  A^  -  A^+j,  the  minimizing  point  (z  ,nr  ) 

T  Z 

(z.-r)€AK 

belongs  to  but  not  to  A^+j.  Since  A^  D  A^+^.  this  gives  <  C^+j,  as 
defined  in  Lemma  9,  and  the  result  follows  from  Lemma  9. 


Using  constrained  optimization,  define  an  objective  functional  as  follows 


L(x.p.a)  =  -  ~  log  (K  +  Pt+  2  x. )  +  $  2  log  x 

1  K+l  K+l 

M  M 

+  2  log  M  +  0(P  +  2  A  -  2  Ax) 

*  K+l  1  K+l  1  1 

M  M 

+  +  +  CT(Pl  +^iXi  "  MXM+K) 

The  Kuhn-Tucker  conditions  are  as  follows 


M  1 


+  — - PA.  +  a.  -  a.,.  +  ct  =  0. 


2  M  K”i  i  1+1 

K+P  +  2  x  ^i 
K+l  1 


(Gl) 


i  =  K+l _ H-l 


M  - L_ -  +  J-  -  PAjj  +  -  o(M-l)  =  0 

K+P.+  2  x  2x* 

1  K+l  1 


(g2) 


MM  MM 

P( P2+  2  V 2  Xixi)  =  °*  V  2  V  2  Vi  *  0 

K+l  1  K+l  1  x  *  K+l  1  K+l  1  1 


a^Xj-x^j)  =  0;  'i  K+2  1  M  H, 


‘W’W1*  -  0:  xK+r1  >  °- 
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must  be 


All  the  parameters  p,  a ^  and  a  are  non-negative.  Note  that 

zero.  We  first  show  that  a  =  =  ...  =  =  0.  Suppose  a  >  0,  so  that 

M 

P,  +  1  x.  +  K  =  Mx,.,  (G0)  then  reduces  to 

1  K+l  1  M  Z 

+  aU~  ct(M_1)  =  0 

ctjj  =  +  (M-I)ct  >  0 

This  gives  x^  =  and  by  (G^) 


-pVl  +  °M-1  '  “M  +  CT  3  0 

=  PCy^j)  +  (M-2 )ct  >  0. 


Continuing  in  this  way,  one  obtains 


XM=XM-1 


=  *K+r  “k+i  "  ^V"- •  +xk+i)  +  Ka- 


a^+i  >  0  contradicts  x^+^  >  1.  If  =  0,  then  existence  of  a  solution  for 

ct  /  0  requires  that  a  and  p  have  opposite  signs,  a  contradiction,  provided 
that  K  >  0.  If  K  =  0  and  —  0,  then  existence  of  a  solution  requires 

P  =  0.  Thus,  ct  =  0  when  p  >  0. 

Now  suppose  that  P  >  0  and  ^  0.  Then  x^  =  Xj|_j,  and  one  obtains 
-/3(Aj|_i-Am)  +  “m-I  “  =  P’  “m-i  ajj  must  each  be  strictly  positive  or 

zero,  and  1  Ajj.  If  =  0-  then  /  0  implies  and  P  have  opposite 

signs,  a  contradiction.  Thus  *  0  and  a^_ ^  =  20^  +  X^) . 


Moreover , 


*M-1  _  *M-2  ~  *M 


.  Thus 


PNt-2  *  “H-2  '  °H-1  *  PNl  ' “m  =  °- 
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or  ~P(\-2  +  aM-2  3aM  ^XM-1  hfl  ~ 

giving  -/3(XM-2+XM-r2XM)  +  °M-2  "  ^  =  °‘ 


As  above,  this  requires  that  ^  0*  so  that  x^_2  =  Xx_3<  Continuing  in  this 

way,  one  obtains  ^  0,  for  all  i  £  M,  contradicting  =  0,  Therefore, 

ctjj  ft  0.  By  similar  arguments,  “jj.j  ,a>i-2’ '  ' '  ,aK+l  must  all  equal  to  zero. 

We  now  have  a  =  + =  ...  =  =  0  when  P  >  0.  Inspecting  the  proof,  one 

sees  that  this  also  holds  when  P  =  0,  provided  that  K  >  0.  If  K  =  0,  then  the 
proof  shows  (if  p  =  0)  that  o(i-l)  =  a^.  i  >  1.  Hence,  the  solution  in  this 
case  is  Xj  =  X2  =  . . .  =  x^.  However,  we  require  that  (since  a  /  0} 

P1  +  ^i  =  "V  which  cannot  be  satisfied  by  =  ...  =  unless  =  0. 
Thus,  we  see  that  a  t  0  is  not  possible  unless  P,  =  0.  This  completes  the 
proof  that  (for  P^  >  0)  a  =  =  ...  =  =  0  is  necessary  in  order  that  the 

minimization  problem  have  a  solution. 

Assuming  now  that  ct  =  =  ...  =  =  0,  it  is  obvious  that  G^  and  G0 

have  a  solution  for  P  =  0,  provided  that  K  >  0,  given  by 
Xj^+j  =  ...  =  =  (P^+K)/K.  However,  we  also  have  the  constraint 

^K+lXiXi  ^  P2  +  ^T-K+lXi’  shows  that  for  this  constant  solution  to  hold, 

it  is  necessary  and  sufficient  that  £  KPg/lJ^A^. 

Thus,  A^  contains  a  solution  to  the  minimization  problem  if 
P1  <;  KP2/r^J+1Ai.  If  such  K  were  the  smallest  integer  i  such  that  yields  a 
solution  to  the  minimization  problem,  then  this  solution  would  give  the  saddle 

M 

point  (z  ,y  )  for  F  on  A,  defined  as  follows: 


\  =  0  i  1  K 

t*  =  Px/K  i  =  K+l . M 
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i  i  K 


A  =  Pj/K 

i 

i 

=  0  i  =  K+l . M.  | 


We  now  assume  that  >  KP2/2^+jXj,  and  that  a  -  a^j  =  ...  =  =  0. 

Now  (Gj)  and  (G^ )  can  be  reduced  to  the  following'. 


M  1 
2  M 

K+P.+  2  x 
1  K+l 


+ 


/3Ai  =  0.  i=K+l . M 


(g3) 


M  M 

Set  2  X.x  =  P„  +  2  X.. 

K+l  1  1  *  K+l  1 

Multiplying  through  (G^)  by  (2xi)I  one  has 


K+P.+  2  x 
1  K+l 


-  20XiXl  =0.  i  =  K+l . M. 


Summing  (G^)  over  all  i,  we  have 


M 

-M  2  x 
K+l 


M 

K+P.+  2  x. 
1  K+l  1 


+ 


M 

(M-K)  -  20(  2  X  x  ) 
K+l  1 


0. 


<C4> 


(g5) 


(g6) 


M 

Put  y  =  2  x, .  Then 

K+l 


-My+CM-KKK+Pj+y) 

_ 

2(P2+  2  Xj )(K+P 1+y) 


(G?) 


It  can  b"  seen  that  0  >  0  is  satisfied  by  G^.  To  see  this,  one  notes  that  the 
numerator  of  G?  is  always  £  0  since  P^  +  K  +  y  l  Mx^  is  a  constraint.  Thus, 
(M-K)(Pj+K)  2  (M-K) (Mx^-y)  £  Ky,  since  the  last  inequality  is  equivalent  to 
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h<4i<V*i»  £  0.  This  shows  that  the  numerator  is  always  non-negative,  and 

that  it  is  strictly  positive  unless  Xj  =  x^  for  i  =  K+l . M.  However,  this 

requires  that  i  ^>2^^K+l^i’  we  are  assum^nS  that  this  inequality  does 
not  hold. 


Returning  to  G^, 


(M-KKK+PjJ-Ky 


2/5(K+P  j+y)  =  - j< 


V  2  Xj 

K+l  J 


Substituting  (Gg)  in  (G,-).  one  obtains 


(g8) 


-MXj  +  (K+P1+y)  - 


[(H-K)(K+P1)-Ky]Xix1 


=  0 


P  +  2  X 
*  K+l  J 


(Cg) 


Thus 


Xi  = 


(P  +  2  X  )(K+P i+y) 
K+l  J  1 


M(P  +  2  K)  +  [(M-K)(K+P  )-Ky]X 
*  K+l  K  1  1 


(P 2+  2  X  )(K+P  +y) 
K+l  J 


MCP2+  2  v(pi+K)\]  '  K(K+p1+y)xi 

K+ 1 


^Gio^ 


where  y  =  2  x  Summing  both  sides  of  G  .y  is  a  solution  of  the  equation 

K+l  1  1U 


M  H 

y  =  (P  +  2  X  )  2 

K+l  J  i=K+l 


K  +  P2  +  y 


mCP2+  2  V(Pl+K)Xi]_K(K+Pl+y)Xi 

K+ 1 


( G 1 1 ) 


Multiplying  (Gjq)  by  (X^)  on  both  sides,  and  summing  over  all  i,  one  obtains 


i 
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K+Pj+y 


M 

I  - 
K+l 


X. 

1 


(gi2) 


M[P2+2K+lV(Pl+K)\]  ~  K<K+Vy)\ 


Substituting  (G^)  in  (G^q) 


x .  = 
1 


P 2  +  2  Xi 

^  K+l  1 


M 


M 

P9+  I  X  +(P  +K)X 
K+l 


-  KCK+Pj+yJXj 


x 


M 

2 

K+l 


X 


1 

i 


V 


5K*lXi^(Pl*K)Xi 


-  KfK+P^yJX. 


(Gn) 


Inspecting  G^_,  it  can  be  seen  that  x^  is  an  increasing  function  of  i, 

K+l  <  i  <  M.  since  (X^)  is  a  non-increasing  sequence  and  (P^+K)(M-K)  -  Ky  >  0 
when  Pj  >  KP2/2jJ+1Xr 

Define  the  right  side  of  to  be  f  (y ) ;  we  now  show  that  G^  yields  a 
unique  solution  y  =  f(y). 

As  previously  shown,  (M-K)(K+P^)  -  Ky  £  0,  so  y  i  (M-K) (K+P^ )/K.  When 
equality  holds  in  this  relation,  we  have  the  solution  y^  =  (M-K) (K+Pj )/K, 

.  Hence,  any  solution  y^  of 

y  =  f (y )  must  satisfy  yx  i  yQ. 

Differentiating  f  with  respect  to  y.  one  obtains 


which  is  the  solution  obtained  when  P^  i 


KP2/ 


4,> 


f  ■  (y ) 


M[v  "  xj] 

1  j=K+l  JJ 


+M(K+P1)X. 


["tP2*ki»iXk5+"it[M'K](K*p‘)"Ky 


f"  is  clearly  strictly  positive,  since  (M-K)(K+Pj)  2  Ky. 
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Thus  f'(y)  >  0  for  y  $  yQ.  Also,  setting  y  =  yQ  =  (M-K) (K+P^ )/K,  one  sees 
that  f(yQ)  =  (M-K)(K+P1+y0)/M  =  yQ. 

Now  f(0)  >  0  and  f(yQ)  =  yQ-  Thus,  there  will  be  a  solution  of  y  =  f(y) 
for  y  <  yQ  if  f'(y)  >  1  in  a  neighbor-hood  of  Yq.  Evaluating  f‘(y)  at  y  =  y^, 
we  obtain 


f 


•(y0) 


-f 


V 


M 

2  ? 
K+l 


J 


M 

2 

i=K+l 


+  mck+p^x. 


M 

2 

s=K+l 


X 


s] 


2 


_  *  j=K+l 

~  M 


(K+Pj) 


M 

2 


*(V  2  X  ] 
L  *  s=K+l  SJ 


This  shows  that  f 1 (y^)  >  1  if  and  only  if 


M 

(K+Pj)  2  X 

j=K+l  J 


>  K(P2  + 


M 

2  X 
i=K+l 


which  holds  if  and  only  if 


K 

P.  >  KP  /  2  X 
1  *  i=K+l  1 


We  have  now  shown  that  a  solution  y  =  f (y )  must  exist  for  y  <  y  when 
Pj  >  KP^/2^ _j^+jXj.  We  claim  that  there  exists  exactly  one  such  solution.  For 
this,  it  is  sufficient  to  show  that  f’’(y)  >  0  for  0  <  y  <  y^.  This  is  clear  by 
inspection  of  the  above  expression  for  f'(y). 

Thus,  we  have  that  a  unique  solution  of  y  =  f(y)  existr  or  y  <  y^,  when 

pi > 

We  now  have  {x^.  i  £  M}  defined  in  terms  of  Pj.Pg.K.M,  {Xi .  K+l  i  i  <  M} , 
and  y,  where  y  =  2^_p,+  jXj  and  Y  must  be  a  solution  of  G^.  Any  solution  (x^) 
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1 


10 


to  the  minimization  problem  must  satisfy  the  constraints:  x^+j  >  1;  xj+1  >  xi 

i  <  M-l ;  Pj  +  K  +  2^_K+1xi  ^  and  ?2  +  ^_K+1^i  ^  ^K+l^j"  When 

Pj  >  ^2^^-K+l^i '  a  s°lut*on  requires  the  parameter  /3  in  to  be  non-zero, 

and  this  requires  that  P 2  +  ^-k+i^i  =  ^j-K+l^jXj"  ^nsP€Ction  of  G^  shows 

that  this  equality  is  satisfied  by  (x^)  as  defined  in  (and  G^)  •  Also,  G 

shows  that  (x^)  is  non-decreasing.  The  constraint  +  K  +  ^  Mx^  is 

satisfied  when  (x^+^ . x^)  is  defined  by  G^q  (or  G^);  to  verify  this,  one 

can  inspect  G^.  If  P^  >  ^>2/,^T-K+l^i '  t^en*  as  previously  shown, 

(M-K)(K+Pj)-Ky  >  0.  Gg  then  shows  that  K+P^+y  >  Mx^.  Thus,  when 

?1  ^  ^^/^-K+l^i '  t*ien  contains  a  solution  to  the  minimization  problem, 

given  by  G^q  (and  G^)-  provided  only  that  >  1. 

To  obtain  a  solution,  one  begins  with  Aq.  If  the  condition  x^  >  1  is  not 

satisfied  by  Aq,  then  Aq  is  not  admissible,  and  one  proceeds  to  Aj  .  If 

?1  ^  ^2^j?-2^i  *2  ^  1  ■  then  Aj  is  not  admissible.  One  then  proceeds  to  Ag, 

and  continues  in  this  way  up  to  the  first  K  such  that  either  P,  i  KP„/2*?  „  ,X. 

12  i=K+l  1 

or  else  P^  >  ^>2^^-K+l^i  XK+1  ^ 

We  summarize  this  development,  and  the  major  results,  in  the  following 
theorem. 

Theorem  1 : 

(1)  The  minimization  problem  will  have  a  solution  in  A^  if  and  only  if  one  of 
the  following  conditions  is  satisfied: 


a)  P  $  KP9/  2  A 
1  *  i=K+l  1 


b)  P.  >  KP0/  2  X.  ,  and  y-, 

t  ^  j  rr  .  ,  1  K+ 


i=K+l 


>  1 


where  Is  defined  by  G^q  (and  G^q). 
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(2)  When  the  minimization  problem  has  a  solution  t  in  A^,  then  Fq(tt  )  has 
the  following  values: 


a)  If  P  <  KP9/  I  A.,  then  =  £  log[l  +  P./K], 

1  Z  i=K+l  1  U  *  1 

M 

b)  If  P  >  KP  /  2  X  .  then 

1  Z  i=K+l  1 


M 


P  +  M  +  2  x  ' 

i=K+l  1 

U 

P.  +  H  +  2  x] 

1  ,i=K+l  1 

M  , 

2  log 

n 

+  2  2  log 

i=K+l 

M 

Mx. 

l 

where  (Xj ,  i=K+l . M}  is  defined  by  G^q  (or  G^). 


3.3.  Information  Capacity 


Essentially,  the  minimization  problem  in  has  two  classes  of  solutions 


one  is  when  Pj  +  2^_K+jXt  +  K  =  Mx^  (in  this  case,  P 2  +  2^_k+jA  £ 


2^_^+jA^'r1 ) ;  the  second  is  when  Pg  +  2^_^+jA^  =  (in  this  case 

P1  +  ^=K+lXi  +  K  2  lixM^*  However,  we  shall  now  show  that  only  one  solution 
can  define  a  saddle  point  for  F  over  A. 


Lemma  1 1  ■’ 

(1)  If  the  minimization  problem  in  A^  has  a  solution  x  such  that  FQ(x  )  is 
the  saddle  value  for  F  on  A,  then  Pj  >  KP^^_^+  j A  . 

(2)  The  saddle  value  of  F(z*,-r*)  of  F  on  A  satisfies 

F(z*.-r*)  <  |  log[l  +  Pj/K] 

where  K  i  M  is  the  smallest  integer  satisfying  P  <  KP0/2^  „  .A..  If  no 
such  K  exists,  then 


F(z*.-r*)  <  |  log 


fP2  +  VlltPi)i 
l  mam  J 


~  2  log  [p2/Xm]- 
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Proof :  (1)  If  the  minimization  problem  has  a  solution  x  in  which  defines 

the  saddle  point  (z  ,t  )  for  F  on  A.  then  (z  ,-r  )  has  the  form: 


w 

^  =  ° 


=  xi  '  1 

2  .Vlid.v 


i  S  K 
i  l  K+l 

i  *  I- 


*i  “  M 

When  ^  ^2/,^d-K+l^i  ’  £^en  a  solution  exists  for  the  minimizati 
problem,  defined  by 


ion 


x*  =  1. 


i  S  K 

x~  =  (Pj+KJ/K  i  *  K+l. 


giving 


* 

Zi  = 


Pj  +  (M-KJPj/K 


M 


Pj  +  (M-K)P1/K 


i  *  K 


-  Px/K  i  *  K+l 


Thus 


<  =  "l^ 


=  0 


i  *  K 
i  2  K+l. 


Inserting  these  values  into  the  definition  of  F  (or  using  FQ(x  ),  one 
obtains 

F(z*,-t*)  =  |  log[l  +  Pj/K], 


Now,  in  order  for  this  to  be  a  saddle  value  for  F.  it  is  necessary  that 

*  M  , 

it  satisfy  F(z  ,-r  )  £  F(z  ,-r)  for  all  admissible  y.  Thus  we  obtain  the 
requirement  that 
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I  log[l  ♦  Pj/K]  S  i  l0g[l  *  j^yt-y 


for  all  sequences  (-r^)  such  that  0  £  "r^,  1  £  i  £  M.  <  Pg-  It  is 

obvious  that  this  cannot  hold.  Thus,  the  saddle  value  cannot  be  obtained  from 
a  solution  of  the  minimization  problem  in  when  £  KP^/S^ 

The  saddle  value  F(z  . t  )  is  the  minimax  value  for  the  jammer.  Thus,  if  K 
is  the  smallest  integer  such  that  the  minimization  problem  has  a  solution  in 

Aj^,  then  by  part  (1).  P^  >  ^2^^-K+l^i ‘  Now.  A^  =  A^  -  A^+^,  as  defined  in 

Lemma  8.  Thus.  A^+^  C  A^+^  C  A^.  The  solution  to  the  minimization  problem  in 

Aj^  gives  a  minimax  solution  for  the  jammer  in  A^,  whose  value  is  C^.  We  have, 

by  Lemma  8.  .  Hence,  if  Pj  i  KP2/2T=K+l^i  '  then  Si  =  f  los[I  + 

as  shown  in  the  proof  of  part  (1).  and  so  the  saddle  value  is  strictly  less 
than  K/2  log[l  +  P  /K]. 

If  Ajj  contains  the  saddle  point,  then  =  .  .  . and  ^  nnist 
satisfy  £  Pg-  Since  A^  always  contains  the  solution  -r^  =  P2/^j(  to  the 

minimization  problem,  the  resulting  value  of  Fq{-t)  is  always  an  upper  bound  on 
the  saddle  value  of  F  on  A.  „ 


Lemma  12-'  A^  contains  a  solution  to  the  minimization  problem  if 


P2  >  2  <Vl  ~  V 

2  i=K+l  *+1  1 


[(M-K)(P1+K)  -Ky]Ai/M 
P2  +  +  C(M~K)(P1+K)  -Ky]X./M 


This  always  holds  when  Pg  1  j ( X^+ j  “  ^j)- 

Proof ••  We  earn  assume  that  P^  >  KP^/fl^j^Xj  ) .  We  then  must  only  show  that 


>  1  holds  if 
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P2  i  -  W  *  H<P2  *  4lV]/IV 


where 


Di  »M 


P9  +  2  X.  +  [(M-K)[P.+K]  -  Ky]X 

Z  j=K+l 


Applying  G^.  >  1  if  and  only  if  ?2  +  2^_k+jXj  >  °k+i^i-k+i  (Xj/Dj  )  •  The 

right  side  can  be  written  as  (Q^/D^ ) ,  where 


Q1  =  VlKVjj^h]  *  CC«-K)(p1+K>  -  Ky]^ 

♦ * JL*J  ■ 

*  \*1D1  *  <VW[P2  *  J+1\]' 

Hence,  x^+j  >  1  if  and  only  if 

* *ivw(vJL>] 


.  l 


-  2  \\ 
k=K+l  KJ 


P2  +  s=l+lX j  >  (M'K)Vl 


+  2 
i=K+l 


D, 


That  is,  if  and  only  if  (*)  holds.  Since  X^  £  ^K+i  ^or  *  £  K+l,  and  >  0  for 
i  £  M,  this  yields  the  desired  result-* 


P2  +  2  ‘"'K)V. 


implies  >  1. 


Note  that  if  X^  =  X^.+  ^  for  i  £  K+l,  then  (*)  is  obviously  satisfied  and  of 
course  in  this  case  (Pg  >  0)  Pg  >  ^-K+l j ^  =  ®-  □ 


Lemma  12  gives  the  necessary  and  sufficient  conditions  for  A^  to  contain 
the  saddle  point  of  F  on  A.  That  is  ,  K  is  the  smallest  integer  such  that  the 
inequality  (*)  of  Lemma  12  is  satisfied.  Lemmas  11  and  12  also  give  easily- 
verified  bounds  on  the  value  of  such  K.  That  is,  by  Lemma  11,  K  must  be  less 
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than  the  smallest  integer  k  (if  such  k  exists)  satisfying  i  ^^2^^-k+l^i' 
For  example,  if  Pj  i  t^en  \)  must  contain  the  saddle  point. 

Moreover,  K  i  k,  where  k  is  the  smallest  integer  such  that  P ^  > 
2^_k+i(^k+i"^i ) •  Of  course,  this  inequality  is  always  satisfied  for  k  =  M. 

We  summarize  the  foregoing  in  the  following  main  theorem. 


Theorem  2 ‘  The  saddle  point  of  F  on  A  is  defined  by  the  solution  of  the 
minimization  problem  in  A^,  where  K  is  the  smallest  integer  such  that  a 
solution  exists.  If  Aq,...,A^ does  not  contain  a  solution  to  the 
minimization  problem,  then  A^  will  contain  a  solution  if  and  only  if  {x^ 
i  £  K+l),  as  defined  in  (or  G^).  satisfies  x^+^  >  1.  This  is  determined 
by  the  smallest  value  of  K  such  that  the  inequality  (*)  of  Lemma  12  is 
satisfied.  A  sufficient  condition  for  this  inequality  to  hold  is  that  P^  > 

.  K  must  be  smaller  than  the  smallest  integer  k  satisfying  P^  < 
-A^).  if  such  an  integer  exists;  in  this  case,  the  saddle  value 

satisf ies 

F(z*,-t*)  <  ^  log(l  +  Pj/k). 

If  no  such  integer  k  exists,  then 


w  *  ✓  m  ,  rp2  +  VM+Plh  ,  ,  ~ 

F(z  •'T  )  <  2  lo«[ - jajj - j  "  2  log  [P^]. 


When  A^.  contains  the  saddle  point,  then  it  is  given  by 

•tj  =  o.  i  £  K. 


i  2  K+l. 
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where  y  = 


CP2+  2  \J  2  - M - ' - 

*  K+l  1  K+1  " 

M[P2+  2  X  +(P  +K)X  ] 
Z  K+l  1  1  1 


-  K(K+P1+y)Xi 


z,  = 


P  i  +  2  ^ 

1  K+l  1 


= 


=  Zj^. 


Zj  *  Zj  -  (1+TTj).  i  =  K+l . M. 

M  M 

F(z.tt)  =  log(l+z1)  -  £  2  log(l+Tf.). 

1  K+l  1 


When  Aq  Is  admissible. 


Ti  = 


P2'*'TrRW _ 1 _ 

VTHVPl\  2  N 


-  1. 


1=1  VTrVP!Xi 


P l  +  2  "I 


- 


1=1.2. ....M 


F(z.„)  =  i  I?  log  (1  ♦  p^gj) 


Remark :  As  seen  from  Theorem  1,  the  capacity  of  this  channel  without  jamming 

M 

is  ^  log(l  +  P^/M).  For  a  sense  of  the  degradation  that  can  be  caused  by  an 
intelligent  jammer,  suppose  that  the  saddle  point  lies  in  Aq.  Then  the  saddle 
value,  or  the  capacity  when  the  Jammer  chooses  his  minimax  strategy,  is 


F(z.nr)  = 


M  1 

?  log(l  + 


|  log(l  +  jp) 


M 

2  2  log 
i=l 


M 

2  2  log 
i=i 


(P2+TrRw)(M+P1)1 


(P2+TrRw+P1Xi)M 
M  +  P, 


P,  X 


1  + 


VTrR*l 
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We  now  list  some  immediate  consequences  of  Theorem  2,  which  are  of 
interest  in  classical  engineering  applications. 

Corollary  1:  Suppose  that  one  uses  the  constraint  E  HxIC  i  P  for  the  jammer. 

Pj  W  2 

The  saddle  point  solution  is  then  given  by  Theorem  2,  setting 

=  ^2  =  =  =  The  s^dle  point  solution  (z,"r)  is  contained  in  A^, 

and  has  the  form** 

P1 

**i  =  jr  1  =  !-2 . M 

P1  +  P2  p2  P1 

Zi  ~  M  ~  M  =  M  1  =  1,2 . M‘ 

Thus,  the  saddle  value  of  F  is 

M  fP2  +  P1  +  H1  M  T  Pi 

F(z.„  .  |  log[  ^  ]  =  *  log[l  *  Jrfj. 

Proof :  The  constraint  on  S  is  Trace  S  =  2^  i  ?^.  Since  (X^  affects  the 
solution  only  through  this  constraint,  the  result  follows. 


Corollary  2:  Consider  the  discrete-time  memoryless  Gaussian  channel: 

W  =  diag[X . •  With  the  constraints  2*1  XT^.  i  MP,  .  2*?  ,-r.  <  MP^.  the 

1  »  1=1  i  i  1  j=l  j  -  2 

optimum  jamming  signal  has  covariance  matrix  diag[t  ^ ,  .  .  .  .nr^] .  with  (n.),  (z.), 

and  the  saddle  value  defined  as  in  Theorem  2.  If  Xj  =  X,  i  =  1 . M,  then 

these  quantities  are  defined  as  in  Corollary  1,  substituting  MXP1  and  MP2  for 
Pj  and  P^.  respectively. 

Proof:  The  first  part  is  obvious,  since  *W  has  the  natural  basis  vectors  (e^) 
as  eigenvectors,  i.e.,  en(j)  =  j •  The  second  part  results  from  the 
constraint  2^_^zt  £  nXP^. 
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4.  COMMENTS  ON  PRIOR  RELATED  WORK 

We  give  a  brief  summary  of  Borden.  Mason,  and  McEliece  (1985).  In  that 

paper,  the  jamming  channel  is  formulated  as  a  two  person  game  with  mutual 

information  as  the  payoff  function.  Their  model  is  the  one-dimensional 

additive  channel,  Y  =  X  +  Z;  Y  is  the  output;  X  the  input.  Z  the  noise.  X  and 

Z  are  independent  random  variables.  I(X;Y)  is  the  mutual  information  between  X 

and  Y.  I(X;Y)  is  determined  by  X  (coder)  and  Z  (jammer),  so  they  use 

$(X,Z)  =  I(X;Y)  to  express  the  payoff  function.  Under  the  assumption  that  the 

2  2 

’’signal  to  noise"  ratio  EX  /EZ  =  A  is  fixed,  they  considered  four  cases  which 
are  distinguished  by  whether  the  input  and/or  output  are  subject  to  some 
quantization  (binary  quantization).  They  derived  some  results  in  each  case. 

When  the  channel  is  additive  Gaussian.  McEliece  and  Stark  (1981)  get  the 
result,  if  there  is  no  quantization  on  input  and  output,  that  the  saddle  point 
is  obtained  when  both  X  and  Z  are  Gaussian.  Using  the  above  notation,  they 

obtain  *(X0;Z0)  =  l  log(l+A).  XQ  -  N(O.EX^).  ZQ  ~  N(O.EZq),  EXq/EZ^  =  A.  One 

_  2  2 
can  obtain  this  from  Theorem  2.13,  using  M  =  1 ,  EZ  =  2A,  EJ  =1. 

5.  GENERAL  DISCUSSION 

Either  in  mismatched  or  in  jamming  matched  models,  it  is  assumed  that  the 
coder  recognized  the  eigenvectors  of  R^,  the  covariance  matrix  foi  the 
additive  noise.  This  is  needed  so  that  he  can  choose  R.v  = 

AA 

l  1 

2iTn[R^vi]  *  and  the  average  mutual  information  can  be  expressed  as 

2  -1 

2^  log(l  +  Xj(l+nr^)  ).  The  jammer  knows  this  solution;  he  will  use  the 
energy  saving  principle  so  that  the  coder  can  not  attain  any  capacity  above 
the  minimax  quantity.  Actually,  the  jamming  matched  Gaussian  channel  is 
considered  in  two  steps,  that  ir. 
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min 

(“*) 


min 

(V 


max  R(z,-r) 
<Zi> 


ai=2Xiaij  *Vi=P2  2zi=Pl 


min 

max 

(V 

(Zi> 

11 

•** 

& 

p2  2zrp 

max 

min 

(Zi) 

<v 

2zrpi 

aiVp 

R(z.y) 


1 


R(z.-r) 

2 


(energy  saving  principle) 


(minimax  theorem). 


The  necessary  and  sufficient  conditions  for  both  the  coder  and  the  jammer 
to  determine  their  saddle  point  strategies  are  that  they  both  have  full 
knowledge  of  the  ambient  Gaussian  noise  added  in  the  channel,  and  that  they 
know  the  opponent's  energy  constraint.  That  is,  the  jammer  knows  the  value  of 
Pj-.  the  coder  knows  the  value  of 

If  the  opponent's  energy  constraint  is  unknown,  and  is  subject  to  a 
random  distribution  over  an  interval  in  R  .  several  variations  can  be 
considered.  If  the  interval  is  bounded,  then  a  minimax  strategy  for  the  player 
is  to  assume  that  his  opponent  will  take  the  largest  energy  with  probability 
one.  The  minimax  information  capacity  is  then  simply  obtained  by  using  that 
largest  right-hand  boundary  value  as  the  energy  constraint.  If  the  interval  is 
unbounded,  a  Bayesian  approach  seems  reasonable  to  consider.  Our  result  can 
then  be  used  as  a  conditional  objective  function  when  P^  and  P2  are  given.  The 
information  capacity  will  be  equal  to  the  expectation  with  respect  to  the 
random  variables  P^  and/or  Pg- 
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